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(g) Dynamic fluid level and bubble inspection for quality and process control. 

@ Fast image acquisition and image process 
control are used to advantage to measure 
dynamic and transient phenomena. This tech- 
nique distinguishes fluid from bubbles by tak> 
Ing an image of a container containing fluid and 
modifying the gray levels of the image. Unmod- 
ified Image processing can be performed with- 
out the disadvantage of large time 
consumption. The technique is used for detect- 
ing fluid levels and bubble, by counting image 
pixels dedicated to bubbles or to fluid along 
vertical or horizontal lines within the Image. The 
rate of change of liquid level and the amount of 
bubbles with time indicate iealcage in contain- 
ers while they are in a dynamic state. The 
Inspection of transient phenomena during a 
dynamic state gives an indication of the final 
quality and quantity of a product inside a corn 
tainer. It also provides feedback for the determi- 
nation of fill nozzle operation, with the 
advantage of easy calibration and adjustment 
for the right amount of bubbles within the 
container. It also provides an indication of 
mechanical or thermal failures and feedback to 
indicate any unit which deviates from preset 
parameters. The system is highly beneficial in 
the beer and soft drink industry where the taste 
of the product Is highly influenced by the 
amount of bubbles within the container. 
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Generally, the field of the invention relates to 
quality and process control, particularly to the inspect 
tion of fluid levels in containers as well as bubbles 
(gas) in the fluid. 

Accordingly one object of the invention Is to pro- 
vide an Improved way to predict final fluid level and 
the amount of dissolved gasses in containers while 
they are moving on a production line. Another object 
Is to be able to perform the foregoing without having 
to squeeze the bottles. Therefore this technique can 
be used to inspect glass containers as well. 

Another object ts to indicate the quality of the fluid 
within the container and if the cap is properly sealed. 
Still another object of the inventton Is to predict the liq- 
uid viscosity as a function of the rate bubbles are dis- 
solved. 

Other objects and advantages are to provide a 
conreiation between the fill nozzle on a filling carou- 
sel and the inspected container for easy nozzle ad- 
justment for the right amount of fluid and bubbles in- 
side a container, thereby to provide an autiimatic 
alann if one of the nozzles on the carousel is off cal- 
ibration. 

Accordingly one object of the present invention is 
to inspect fluid -filled containers at areas other than 
near the filling station, including areas ahead of the 
filling station. 

The invention generally comprises a method for 
inspecting containers filled with a liquid containing 
bubbles, while said liquid and said bubbles are In a dy- 
namic state and are moving on a production line, with 
the use of a sensor and a processing unit having a 
memory, comprising: 

(a) moving a series of containers along a produc- 
tion line past a filling station and an inspection 
station, 

(b) filling said series of containers with a liquid 
and a gas at said filling station, said liquid in said 
containers thereby containing bubbles which are 
suspended In said liquid, said liquid and said sus- 
pended bubbles being in a dynamic state as a re- 
sult of said filling, 

(c) illuminating said containers with light at said 
inspection station so that resultant light comes 
from said containers, 

(d) sensing said resultant light coming from said 
containers with said sensor at said inspection sta- 
tion and converting said resultant light to an elec- 
trical signal, 

(e) said containers being illuminated and sensed 
when said liquid and said suspended bubbles are 
still in said dynamic state as a result of said filling, 

(f) creating, from said electrical signal, a product 
image comprising a multiplicity of pixels with: 

(1) said pixels having a plurality of intensity 
levels expressed as a corresponding plurality 
of respective gray levels, 

(2) a first plurality of said multiplicity of pixels 



representing said liquid and having gray lev- 
els substantially on one side of a predeter- 
mined threshold level, and 
(3) a second plurality of said multiplicity of pix- 
5 els representing said bubbles and having gray 

levels substantially on the other side of said 
. predetermined threshold level. 

(g) modifying said product image to produce a 
modified product Image so as to distinguish liquid 

10 from bubbles by assigning a predetermined sin- 

gle liquid gray level value to all pixels on said one 
side of said predetermined threshold level, and 
assigning a predetermined different and single 
bubble gray level value to all pixels on said other 

15 side of said predetermined threshold level, 

(h) counting the number of pixels having said liq- 
uid gray level value and saving the resultant liquid 
count in memory, 

(i) counting the number of pixels having said bub- 
20 ble gray level value and saving the resultant bub- 
ble pbcel count in memory, and 

(j) analyzing said resultant liquid pixel count and 
said resultant bubble pixel count for liquid height 
and bubbles. 

25 The invention also comprises a system for in- 

specting containers filled with a liquid containing bub- 
bles, while said liquid and said bubbles are in a dy- 
namic state and are moving on a production line, with 
the use of a sensor and a processing unit having a 

30 niemory, comprising: 

(a) a production line comprising a filling station 
and an inspection station. 

(b) moving means for moving a series of contain- 
ers along said production tine past said filling sta- 

35 tion and said inspection station, 

(c) fining means at said filling station for filling 
said containers with a liquid and a gas so that said 
liquid in said containers will contain suspended 
bubbles, said liquid and said suspended bubbles 

40 being in a dynamic state as a result of said filling, 

(d) illuminating means at said Inspection station 
for Illuminating said containers with light so that 
resultant light comes from each of said contain- 
ers, 

45 (e) sensing and converting means at said inspec- 

tion station for (a) sensing said resultant light 
coming from said one of said containers, said 
sensing and converting means including said 
sensor, and (b) converting said resultant light to 

50 an electrical signal, 

(f) said Illuminating means illuminating said con- 
tainers with light, and said sensing and convert- 
ing means sensing said resultant light coming 
from said containers, when said liquid and said 

55 suspended bubbles are still in said dynamic state 

as a result of said filling, 

(g) Image means for creating, from said electrical 
signal, a product image comprising a multiplicity 
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of pixels, said image means arranged to cause 
said pixels to have a plurality of intensity levels 
expressed as a corresponding plurality of respec- 
tive gray levels, with a first plurality of said mul- 
tiplicity of pixels representing said liquid and hav- 
ing gray levels substantially on one side of a pre- 
determined threshold level, and a second plural- 
ity of said multiplicity of pixels representing said 
bubbles and having gray levels substantially on 
the other side of said predetermined threshold 
level. 

(h) modifying means for modifying said product 
Image to produce a modified product Image so as 
to distinguish liquid from bubbles by assigning a 
predetermined single liquid gray level value to all 
pbcels on said one side of said predetermined 
threshold level, and assigning a predetermined 
different and single bubble gray level value to all 
pbcels on said other side of said predetermined 
threshold level, 

(i) liquid pixel counting means for counting the 
number of pixels having said liquid gray level val- 
ue and saving the resultant liquid pixel count in 
memory, 

(j) bubble pbcel counting means for counting the 
number of pixels having said bubble gray level 
value and saving the resultant bubble pbcel count 
in memory, and 

(k) analyzing means for analyzing said resultant 

liquid pixel count and said resultant bubble pixel 

count for liquid height and bubbles. 

The invention also comprises a system for In- 
specting containers filed with liquid containing but>- 
bles. while said liquid and said bubbles are in a dy- 
namic state and are moving on a production line, with 
the use of an action station and an inspection station, 
comprising:. 

(a) an action station means for operating on a 
plurality of containers so that said containers 
contain a liquid and a gas with said liquid being 
in a dynamic state, and said gas being suspended 
In said liquid In the form of bubbles which also are 
in said dynamic state, 

(b) an inspection station means for c:reating an 
image of said containers filled with said liquid and 
said bubbles in said a dynamic state with the use 
of a light source and a sensor, 

(c) said inspection station means arranged to cre- 
ate an image comprising a multitude of pixels 
having a plurality of gray levels representing said 
fluid and multitude of other pixels with a plurality 
of gray levels representing said bubbles, 

(d) said inspection station means having a nnem- 
ory and a processor for obtaining intensity values 
of said pbcels for obtaining gray level values of 
said pbcels, for mathematic^al calculations, and for 
classifying some of said pbcels as fluid pixels and 
others of said pixels as bubble pixels and saving 



the classification in said memory, 
(e) counting means for performing a first count of 
said pixels representing fluid and a second count 
of said pixels representing bubbles, 
5 (f) analyzing means for analyzing said first count 

and said second count for quality and process 
control, and 

<g) correlating means responsive to said analyz- 
ing means for Indicating any nnalfunction of said 
10 action station for quality and process control. 

The Invention also comprises a system for moni- 
toring quality and process control of a production line 
by inspecting (X>ntalners filed with liquid, while said 
liquid is in a dynamic state and said containers are 
15 moving on a production line, with the use of an action 
station and an inspection station, comprising: 

(a) an action station means for operating on said 
plurality of containers containing a liquid causing 
said liquid to being in a dynamic state as a result 

20 of said operation, 

(b) an inspection station means for creating an 
image of said containers filled with said fluid and 
said bubbles in said a dynamic state with the use 
of a light source and a sensor, 

25 (c) said inspection station means arranged to cre- 

ate an image comprising a multitude of pixels 
having a plurality of gray levels representing said 
fluid. 

(d) said inspect'ion station means having a mem- 
30 ory and a processor for obtaining Intensity values 

of said pixels for obtaining gray level value of said 
pbcels, for mathematical calculations, and for 
classifying said pbcels as fluid pbcels or as bubble 
pbcels and saving said classification In said menv 
35 ory, 

(e) counting means for performing a first count of 
said pixels representing fluid and second cx)unt of 
any pixels representing bubbles, 

(f) analyzing means for analyzing said first count 
40 and said second count for quality and process 

control, and 

(g) correlating means responsive to said analyz- 
ing means for indicating any malfunction of said 
ac:tion station for quality and process control. 

45 The invention also comprises a method for mon- 

itoring quality and process control of production line 
by inspecting containers filed with liquid containing 
bubbles, while said liquid and said bubbles are in a dy- 
namic state and are moving on a producrtion line, with 

50 the use of an action station and an inspection station, 
comprising: 

(a) operating on a plurality of containers at an ac- 
tion station so that said containers contain a liq- 
uid and a gas with said liquid in a dynamic state, 

55 and said gas is suspended in said liquid in the 

form of bubbles which also are in said dynamic 
state. 

(b) creating with an inspection station an image 
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of said containers filled with said liquid and said 
bubbles in said dynamic state with the use of a 
light source and a sensor. 

(c) said image comprising a multitude of pbcels 
having a plurality of gray levels representing said 5 
fluid, and multitude of other pbcels with a plurality 

of gray levels representing said bubbles, 

(d) obtaining intensities of pbcels at said inspec- 
tion station using a processor to obtain gray level 
values of said pixels for mathematical calcula- io 
tions, and for classifying some of said pbcels as 
fluid pixels and others of said pbcels as bubbles, 

(e) saving the classification of said pixels in a 
memory, 

(f) counting said pbcels which represent liquid to 15 
provide a first count of liquid pixels and counting 

said pixels which represent bubbles to provide a 
second count of pbcels representing bubbles, 

(g) analyzing said first count and. said second 
count for quality and process control, and -20 

(h) correlating the analysis of said first and sec- 
ond counts with said action station to indic:ate any 
malfunction of said action station for quality and 
process control. 

The invention also comprises a method for mon- 25 
itoring quality and proc:ess control of a production line 
by inspecting liquid in a dynamic state and moving on 
a production line, with the use of an a(;tion station and 
an inspection station. cx)mprising: 

(a) operating on a plurality of containers at an ac- so 
tion station so that said containers contain liquid 

in a dynamic state, 

(b) creating, with said inspection station images 
of said containers filled with said liquid in said dy- 
namic state with the use of a light sourcie and a 3S 
sensor. 

(c) said image comprising a multitude of pixels 
having a plurality of gray levels representing said 
liquid, 

(d) obtaining intensities of said pixels at said in- 40 
spection station using a processor to obtain gray 
level values of said pixels for mathematical calcu- 
lations, and for classification of said pixels as flu- 
id pixels or bubble pixels, 

(e) saving the classification of said pbcels in a 45 
memory, 

(f) counting said pbcels which represent liquid to 
provide a first count of liquid pbcels and cx>unting 
any pbcels which represent bubbles to provide a 
second cjount of any pbcels representing bubbles, so 

(g) analyzing said first count and said second 
cx>unt for quality and process control, and 

(h) correlating the analysis of said first and sec- 
ond counts to said action station to indicate nnal- 

f unction of said action station for quality and 55 
process control. 

The invention also comprises a method for mon- 
itoring quality and process control of production line 



by inspecting liquid in a dynamic state and moving on 
a production line, with the use of an action station and 
an inspection station, comprising: 

(a) operating on a plurality of containers at an ac- 
tion station so that said containers contain liquid 
in a dynamic state, 

(b) creating, with said inspection station an image 
of said containers filled with said liquid in said dy- 
namic state with the use of a light source and a 
sensor, 

(c) said image comprising a multitude of pbcels 
having a plurality of gray levels representing said 
liquid, 

(d) obtaining the intensities of pixels at said in- 
spection station using a processor to obtain the 
gray level values of said pixels for mathematical 
calculations, and for classifying said pbcels as flu- 
id pixels or as bubble pixels, 

(e) saving the classif ic^ion of said pbcels in a 
. memory, 

(f) counting said pbcels representing liquid to pro- 
vide a fluid count, 

(g) analyzing said fluid cxiunt for quality and proc- 
ess (x>ntrol. and 

(h) correlating the analysis of said fluid cx>unt to 
indicate any malfunction at said action station. 
Other objec^ts are as follows: 

(1) to inspect a dynamic fluid for the presence of 
gas that was intentionally injec^ted into the fluid 
and to recommend any needed filling adjustment 
for fluid or gas. 

(2) to inspect a dynamic fluid for the presence of 
unwanted gas that was unintentionally injected 
into the fluid and to recommend any needed fill- 
ing adjustment for fluid or gas. 

(3) to indicate a malfunctioning filling unit, e.g., 
one which produces insufficient or no gas and to 
correlate the malfunctioning unit with inspected 
containers for quality and process control, 

(4) to inspect dynamic fluid that is not supposed 
to have gas, i.e., to inspect for the presenee of un- 
wanted gas in a fluid where the gas was uninten- 
tionally injected into the container by a malfunc- 
tioning unit 

(5) to indicate a malfunctioning filling unit, e.g., 
one which creates unwanted gas or air, and to 
correlate the malfunctioning unit with containers 
for quality and process control, 

(6) to indicate a malfunctioning pasteurization 
unit, e.g., one which creates unwanted gas or air, 
(as a result of over or under heating) and to cor- 
relate the malfunctioning unit with an inspected 
containers for quality and process control, 

(7) to provide an improved way to predictf inal flu- 
id level and the amount of dissolved gasses in 
containers while they move on a production line, 

(8) to indicate the quality of the fluid within the 
container and whether the container's cap is 
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properly sealed, 

(9) to predict a liquid's viscosity as a function of 
the rate bubbles In the liquid are dissolving, 

(10) to create a dynamic state of fluid and bubbles 
by the use of thermal or mechanical forces to im- 
plement inspection past the filling or the pasteur- 
izing station, 

(11) to provide Improved an way to Inspect a pas- 
teurization process by the amount of gas or air for 
quality and process control. 

(12) to inspect ungassed dynamic fluids for the 
existence of bubbles for quality and process con- 
trol, and 

(13) to correlate a fill nozzle on a filling carousel 
with an inspected container for easy nozzle ad- 
justment for the right amount of fluid and bubbles 
inside a container, thereby to provide an automat- 
ic alanm if one of the nozzles on the carousel is 
off calibration. 

Reference will now be made to the accompanying 
drawings, in which:- 

Fig 1 is a schematic view of a fluid filling system 
employing an image processor for quality and proc- 
ess control, in accordance with the invention. 

Fig 2 is a schematic view of a system with an ac- 
tion or force creating station for producing a fluid in a 
dynamic state, employing an image processor in ac- 
cordance with the invention. 

Fig 3 is a view of a camera's field of view showing 
a fluid level and bubbles within the fluid in accordance 
with the invention. 

Fig 4 Is a measurement of the fluid's height along 
one column within the camera's field of view, in accor- 
dance with the invention. 

Fig 5 is a the measurement of the bubbles along 
one row within the camera's field of view, in accor- 
dance with the invention. 

Fig 6 shows the fluid level height asymptotically 
approaching a static value, in accordance with the in- 
vention. 

Fig 7 shows the annount of bubbles asymptotical- 
ly approaching a static value as they dissolve within 
the fluid, in accordance with the invention. 

General Simmiary Of The Method 

The nr»ethod of the Invention comprises the fol- 
lowing sequential steps: 

(1) An action unit operates with mechanical or 
thermal forces on containers filled with fluid that 
are moving on a production line. 

(2) The fluid level inside a container is scanned 
optically while the fluid is in a dynamic state. The 
dynamic state is created by a mechanical force, 
a thermal force, or both. The scan produces a 
product image having gray levels 

(3) Gray levels of neighbor pixels of the product 
image are compared to distinguish bubbles from 



liquid, or the gray levels in the image are modified 
or quantized. 

(4) The fluid height is measured once or several 
times. 

5 (6) The amount of bubbles (gas) within the fluid 

is measured once or several times. 
(6) The data from the measured fluid height (step 
3) and bubble measurement (step 4) is correlated 
to the action unit using a mathematical function 

10 (7) The fluid height, the amount of bubbles and 

the rate of change of fluid height and bubbles are 
analyzed and compared with the dynamic range 
and behavior of an acceptable product. 

(8) The container is tested for leaks by analyzing 
IS the dynamic behavior of the fluid and the bub- 
bles. 

(9) The container is tested for quality and process . 
control. 

Each of the above steps will now be considered 
20. separately, in detail. . 

Fig 1 -Filling Carouse! 

The inspection system is able to inspect contain- 
25 ers filled with dynamic fluid and bubbles as shown in 
Fig 1. This system comprises a measuring system 
employing a sensor 1 08 located a short distance after 
a filling carousel 105. This system inspects the dy- 
namic processes within each container. This location 
30 is used because the fluid inside containers 109 is still 
active due to filling operation so the bubbles can be 
easily seen. 

Incoming containers 102 move in a direction 101 
on an input conveyor 112 to be picked up by a carou- 

35 sel 1 05. Nozzles 1 04 on the carousel are used for f ili- 
ing the containers with fluid and dissolved gases. The 
carousel nutates about axis 106 in a clockwise direc- 
tion 115. The containers leave the carousel on an out- 
put conveyor 111. Bottle sensors 103 and 108 are 

40 used to correlate a particular container on output con- 
veyor 111 with a specific fill nozzle. Camera 114 and 
Image processor 113 take Images of the containers 
as they move along conveyor 111. 

After filling at carousel 105. the fluid inside con- 

45 tainer 209 is in a very active transient condition or dy- 
namic state. This dynamic state is easy to detect elec- 
tronically. This eliminates the need to shake the con- 
tainer to cause the gas to separate from the fluid. 
A plurality of images of container 109 are taken 

50 or acquired by camera 114 and processor 113. Image 
processor 113 counts pixels in the container's image. 
This system also inspects the amount of bubbles in- 
side the containers, the rate at which they dissolve, 
and the viscosity of the liquid. The containers may in- 

55 elude water, beer, wine, liquid medicine, oil, blood, or 
any other fluid. 

The images are stored in the memory (not 
shown) of processor 113. Camera 114 has a field of 
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view which includes the surface of the container's liq- 
uid level as well as the bubbles in the liquid. This field 
of view is shown in Fig 3. The gray levels of the image 
are modified (quantized) in a known manner to distin- 
guish liquid from bubbles. This is done by selecting a 
threshold level for liquid and for bubbles and applying 
a lookup table of the vision system (explained below) 
as described, e.g., in patent 5.204,911, granted to 
Schwartz et al., Apr. 20, 1993. 

The liquid height is measured by counting the 
number of pixels relating to the fluid along each line 
(or column) of the modified Image, as will be ex- 
plained in conjunction with Fig 4 below. In Fig 4 the 
fluid image is modified to have gray levels of value M. 
Counting of pixels can be performed by the vision 
system. This is done by using the vision system's his- 
togram feature, i.e., by defining a 'window* or area of 
interest (AOI) inside an image as one line only. The 
resultant scan will be a histogram vector which is a 
count of the number of pixels with equal gray level val- 
ues. Therefore it is a count of pbcels with gray levels 
of value M, the value to which the fluid image's gray 
levels were modified. In the present case it is the 
number of pixels of fluid along the vertical line. 

Another fast way to count pixels while using a vi- 
sion system is described in the above patent 
5.204,911. In the system of this patent, the template 
image is an assembly of lines of different gray levels. 
The template is superposed with a modif ied image as 
shown in Figs 4 or 5. The histogram of the superposed 
images will resolve with the counts of pbcels along 
vertical or horizontal lines. Averaging the count val- 
ues will indicate the average liquid level. This system 
preferably employs a Model 150/151 image proces- 
sor made by Imaging Technology Inc. of Woburn, 
IVIass. 

The bubbles are measured by counting the nunv 
ber of pixels of the bubbles along each line (or col- 
umn) of the modified image. The count value indi- 
cates the amount of bubbles Inside the liquid. Since 
a plurality of images are acquired, a plot of liquki 
heights, or amount of bubbles as a function of time Is 
generated. The rate of change of each plot, and a 
comparison with a good container's behavior, predict 
the viscosity of the liquid, as well as the existence of 
any leaks in the container. 

Pn3cessor 11 3 counts the number of bubbles, the 
height of the fluid during a period of tinr^e, and then 
compares the dynamics of each container to deter- 
mine if the fluid inside behaves within predefined de- 
viations. The results are then compared to a good 
container's behavior, which has been previously stor- 
ed In the processor, and are also compared to the op- 
eratk>n of other nozzles on the carousel. The sensors 
enable the quick identification of faulty nozzles whidi 
may require adjustment. 



Modifying Product Image 

The gray level values of the product image are 
modified in order to quantize such levels to distin- 
5 gulsh bubbles from liquid. This is done in real time us- 
ing look up tables and existing hardware, as fully 
shown in Fig 2 below. 

Fig 2 -Action Station 

10 

Fig 2 show containers 202 that move on input 
conveyor 212 in direction 201 , towards an action sta- 
tion 203. The action station operates on the contain- 
era. The action station can be a filling station, a heat- 
is ing (pasteurizatton) station, a gas or air injection sta- 
tion, a shaking station, and any combination of the 
above. After treatment at the action station, the con- 
tainers move in direction 207 on output conveyor 21 1 . 
The containers are sensed with a known sensor 208 
20 to correlate inspected containers, such as 209. with 
action units, such as nozzles or heating pads (not 
shown), inskie the actk>n station. Such correlation is 
performed within processor 21 3 in a known manner. 
Inspection is performed by the use of a light source 
25 210 and/or 215. camera 214, and image processor 
213. 

The current inspection process looks not only for 
bubbles in the fluid that are expected to be there, but 
also for bubbles that are not expected to be there. For 

30 example If the actbn station fills the containers with 
fluid only (no gas) and inspection of the containers 
shows bubbles of gas or air in some or all of the con- 
tainers, this indicates a malfunction. Also an exces- 
sive amount of bubbles may be an indication of a fail- 

35 ure of a nosle on the filling carousel, or another prob- 
lem that the maintenance engineers must correct 

A case where an excessive amount of bubbles is 
not tolerated occurs during and after a pasteurization 
process. This may indicate overheating the container, 

40 causing the product to disintegrate. Oonrelating the 
container that was overheated with the heating unit is 
very important for in process and quality control. 
Elimination of the source that creates excessive 
amount of bubbles prolongs the shelf life of the prod- 

45 uct dramatically, e.g., two times longer. 

So, while the system of Fig 2 uses an image proc- 
essor 213 identical to that of processor 113 of Fig 1 , 
it measures different physical phenomena. In both 
cases the system counts pixels. However the Fig 2 

50 system counts, in the container's image, pixels which 
display different physical phenomena, originated by 
different forces. Indeed to an outside observer it may 
look like the same physical phenomena, (since bub- 
bles are the same wherever found). However differ- 

55 ent mathematical equations will be needed to descri- 
bed the present case. They may involve different 
parameters, such as defects size on the fill nozzle, 
amount of heat injected into an inspected container, 
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fluid temperature, and much more. Different mathe- 
matical equations are needed to describe different 
physical phenomena. The mathematical equations 
are very complicated and most of the time impossible 
to solve. This present system tries to overcome this 
mathematical difficulty by inspecting the fluid's be- 
havior, analyzing its images, predicting quality, and 
establishing correlation of the action station and an 
inspected container for process control. 

The present system also inspects the amount of 
bubbles Inside the containers, the rate at which they 
dissolve, and as a result the viscosity of the liquid. 
The containers may include water, beer, wine, liquid 
medicine, oil, blood, or any other fluid. The present in- 
spection system uses those counts In a unique man- 
ner to predict final static value of liquid level, amount 
of dissolved gas. and to evaluate liquid viscosity. 

After action station 203, the fluid inside the con- 
tainer is in every active transient condition. This dy- 
namic state is easy to detect by the presence of sus- 
pended bubbles in motion, by the change of fluid 
height with time, by the dissolving of bubbles (gas/air) 
in the fluid, and by the presence of fluid motion inside 
the container. 

A measuring system employing a sensor 208 is 
located a short distance after filling action station 
203. This system inspects the dynamic processes 
within each container. This location is used because 
the fluid inside containers 209 is-stiti active and the 
bubbles can be easily seen. 

A plurality of images of container 209 are ac- 
quired by camera 214 and processor 213, and are 
stored in the memory (not shown) of processor 21 3. 
Camera 214 has a field of view which includes the 
surface of the container's liquid level as well as the 
bubbles. This field of view Is shown in Fig 3. 

The gray levels of the Image are modified to 
quantize them so as to distinguish liquid from bub- 
bles. This is done by selecting a threshold level for liq- 
uid and for bubbles and applying a lookup table of the 
vision system. 

However, In the case of containers which move at 
slow speed (slow throughput), it is not necessary to 
quantize (modify) the image gray levels to distinguish 
fluid from bubbles. Adjusting the output video signal 
from camera 214 to the input of Image processor 214 
to brighten the image will do the job as well. In this 
case the image includes a multiplicity of gray level 
values. Counting pbcels can be done by the use of 
methods well know in the art. such as edge detection, 
blob detection, filtering, and other methods. Those 
methods are considered slow, i.e., they require a lot 
of time and therefore have a disadvantage with re- 
spect to the method where the image gray levels are 
modified to distinguish bubbles from liquid . For ex- 
ample the image gray levels can be modified to have 
only two gray level, a histogram vector can be made 
only two places long (for the two gray levels) rather 



than 128 places long (for the standard gray level cam- 
era). A vector two places long can be processed much 
faster than a vector 128 places long. Both of the meth- 
ods will resolve with the same data. 

5 The liquid height is measured by counting the 

number of pbcels relating to fluid along each line (or 
column) of the modified Image, as will be explained 
in conjunction with Fig 4 below. In Fig 4 the fluid inn- 
age is modified to have gray levels of value M. Count- 

10 ing of pixels can be performed by the vision system. 
This Is done by using the vision system's histogram 
feature, i.e., by defining a 'window* or area of interest 
(AOI) inside an Image as one line only. The resultant 
scan will be a histogram vector which is a count of the 

IS number of pixels with equal gray level values. There- 
fore it is a count of pbcels with gray, levels of value M, 
the value to which the flutel image's gray levels were 
modified, in the present case it is the number of pixels 
of fluid along the vertical line. Another fast way to 

20 count pbcels while using a vision system like Image 
Technology, Inc's f^odel 150/151 processor, is de- 
scribed in above patent No. 5,204,911. where the 
template image is an assembly of lines of different 
gray levels. The template is superposed with a modh 

25 fied image as shown in Figs 4 or 5. The histogram of 
the superposed images will resolve with the counts of 
pbcels along vertical or horizontal lines. Averaging the 
count values will indicate the average liquid level. 
The bubbles are measured by counting the nunrv 

30 ber of pixels of the bubbles along each line (or col- 
umn) of the modified image, as be explained in con- 
junction with Fig 5 below. Counting of pixels is per- 
formed by setting the vision system to define a 'win- 
dow* or area of Interest (AOI) inside an image as one 

35 line only. The resultant histogram c:ount will be a vec- 
tor which is a count of the number of pbcels with equal 
gray level values. Therefore it is a count of pbcels with 
gray levels of value K, the value to which the bubble 
image's gray levels were modified. In the current 

40 case it is the number of pixels of bubbles along the 
vertical or horizontal line. Another fast way to count 
pixels while using a vision system is defined in above 
patent 5,204.911, where the template image is an as- 
sembly of lines of different gray levels. Averaging the 

45 count values will indicate the average liquid level. 

The count value indicates the amount of bubbles 
inskle the liquid. Since a plurality of images are ac- 
quired, a plot of liquid heights, or amount of bubbles 
as a function of time, is generated (Figs 6 and 7). The 

50 rate of change of each plot, and a comparison with a 
good container's behavior, predictthe viscosity of the 
liquid, as well as the existence of any leaks in the con- 
tainer. 

Processor 213 counts the number of bubbles and 
55 the height of the flu Id during a period of time, and then 
compares the dynamics of each container to deter- 
mine if the fluid inside behaves within predefined de- 
viatk>ns. The results are then compared to a good 
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container's behavior, which has been previously stor- 
ed in the processor, and are also compared to the op- 
eration of other nozzles on the carousel. The sensors 
enable the quick identification of faulty nozzles which 
may require adjustment. 5 

Modifying Product Image 

Modification of the gray level values of the pixels 
of the product image, using lookup tables, is done in io 
real time using existing hardware. The gray levels are 
modified or quantized in order to distinguish pixels 
representing bubbles (gas) from pixels representing 
liquid and to make It easier and therefore faster on the 
counting process. (Other methods can distinguish is 
bubbles from liquid). The tables are loaded with data 
during startup of the computer. The data define the 
conversion function change in real time. For refer- 
ence see the operating manual, "Lookup Tables" 

(LUT). Technical Publications Department, 1990, 1 m- 20 

age Technology, inc., Woburn, Mass. The lookup ta- 
bles are used to modify the gray levels of the image. 
The lookup tables are loaded with a transform func- 
tion. The transform function is unique for each prod- 
uct and is well known to those skilled in the art E.g., 25 
the transformation function for a beer bottle is as fol- 
lows: all gray levels in the product image between 0 
to 150 (i.e., below threshold level 150) are converted 
to gray value 0, and all gray levels between 151 and 
255 converted to gray level 160. 30 

The image acquired by camera 214 and shown in 
Fig 3 is modified to have bubbles displayed as dark 
gray levels, as shown in Figs 4 and 5. This is done ac- 
cording to the lookup tables. This makes it possible to 
count pixels related the two groups, pixels related to 35 
liquid and pixels related to bubbles. The vision system 
is able to count liquid height by counting the number 
of pixels related to the fluid inside the container. Each 
image is composed of plurality of pixels aligned in col- 
umns and rows. The counts takes place along a line 40 
which is a column or row in the modified image. The 
final fluid height is obtained by averaging the counts 
over the number of lines that pixels were counted, as 
explained in detail in equations (1) and (2) below. 

This modification of the image gray levels is per- 45 
formed with the aid of back light source 21 5 in Fig 2. 
Light rays from source 215 shine toward minror 210, 
are reflected from the minror, pass through the f lukJ 
inside the container, and then travel back to camera 
214. That makes It possible to have the camera and so 
the light source on the same side of the conveyor, pro- 
viding mechanical and optical advantages. The cam- 
era should be slightly above the light source so that 
light coming from the container will be collected. A 
simpler configuration where the camera is on one 55 
side of the conveyor and the light source Is on the 
other side of the conveyor is also possible. 

However, In the case of the containers have slow 



throughput speed, it Is not necessary to modify the 
image gray levels to distinguish fluid from bubbles. 
Adjusting the output video signal from camera 214 to 
the input of image processor 214 to brighten the in> 
age will do the job as well. In this case the image in- 
cludes a multiplicity of gray level values. Counting 
pixels can be done by the use of methods well know 
in the art, such as access by the processor to each of 
the image's pixels by address or by intensity (gray 
level), edge detection, blob detection, filtering and 
other methods. As stated, methods are considered 
slow, i.e., they require a long processing time and are 
not as good as nrK>difying the image gray levels. 

However, when the containers have a slow 
throughput speed, it is not necessary to modify the 
image to distinguish fluki from bubbles and gain fast 
counting process. However since the image contains 
a plurality of gray levels, the time consumption of 
counting pixels with gray levels which relate to bub- 
bles or fluid Is significantly larger, as we will show be- 
low. 

Fig 3-Dynamic State Inside Container 

In order to follow the dynamic behavior of a fluid, 
multiple images of the container are required. Today's 
computer technology is fast enough to acqure multi- 
ple images, and the 

Fig. 3 illustrates a single image 301 , which is field 
of view 107 of container 102 (Fig 1), or the neck of 
container 209 (Fig 2). Multiple images of container 
209 are acquired by camera 214 and are stored in the 
memory of processor 213 (Fig 2). Images are ac- 
quired at equally spaced times. 

The container's fluid level 302 is a wavy line, in- 
dicating that the fluid is in a dynamic state. The exis- 
tence of bubbles 303 also indicates that the fluid is in 
a dynamic state. The image gray levels (not shown) 
contain many gray levels, some representing fluid 
and others representing bubbles. These gray levels 
are modified so that the fluid is expressed as one 
gray level (M, Fig 4) and the bubbles as another gray 
level (K, Fig 4).] This is done by selecting a suitable 
gray level threshold. The selected gray level thresh- 
old is the one allowing the maximum number of pixels 
related to bubbles to be shown in the modified image. 
If the threshold is not selected correctly, fewer bub- 
bles are shown in the image. In the example previous- 
ly given, under "Modifying Product Image", the gray 
level range was 0 to 255, so that the threshold level 
must be within this range. 

First the threshold is selected as value 0. Then it 
is increased to be of value 1, and so on. For each 
threshold selection, the number of pixels related to 
bubbles are counted. The threshold with the msuci- 
mum bubble pixels is selected. All the gray levels 
above that threshold are converted to one gray level 
value. All gray levels below that threshold are convert- 
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ed to another gray level value, thereby to form an im- 
age with two gray level values. 

A ternary image with three gray level values can 
also be provided, as shown in Fig 4. One gray level 
value K Is for bubbles, a second gray level M is for the 
fluid, and a third gray level L is for the medium (air) 
above the fluid's surface. Aternary Is used when ever 
the camera f ield of view include three types of media. 

A camera's field of view may indudes multiple 
types media E.g., another situation when more than 
two gray level values is used occurs if container in- 
cludes several types of fluids, layered on top of each 
other. That case will require a specific gray level value 
for each layer of fluid inside the container. A suitable 
threshold level is unique to each product and Is select- 
ed experimentally. 

Fig 4-Measuring Fluid Height In Dynamic State 

Fig 4 is similar to Fig 3, and is used to demon- 
strate the procedure' of measuring the fluid" level 
height inside a container while the fluid is in a dynamic 
state. 

The gray levels (not shown) of Fig 3 are modified 
by the use of the LUTs of processor 213. They appear 
as shown in Fig 4, where bubbles such as 401 are 
darkened and set to a gray level K, versus the bubbles 
in Fig 3 which have multiple gray levels. Using the 
same procedure for gray level modification, the gray 
levels of the fluid (below wavy line 302 in Fig 3) are 
modified to be of value M. different that of the air do- 
main (above line 302 In Fig 3) which Is modified to be 
of a gray level value L. The gray level of the bubbles 
is different from that of the liquid and from the air do- 
main above the liquid's wavy surfece. 

A long vertical line or column 402 is used to cal- 
culate fluid height 403. The vision system is selected 
to scan one vertical line as an area of interest (AOI). 
The histogram feature is constrained to count pixels 
within the selected AOI only. The processor is set to 
move the AOI from line to line so that the entire body 
of fluid will be covered in real time and in sequential 
. order. Different AOIs are possible on the same image. 
Vertical line 402 is a modified Image line composed 
of a row of pixels. E.g., distance between point 403 
and point 404 is 25 pbcels. This will be the height of 
the fluid along line 402 in a static state, i.e., a fluid 
without bubbles. 

As stated, the fluid is in a dynamic state, and 
there is a bubble 401 with two pixels long along vert- 
ical line 402. The actual height of the fluid will be less 
than 25 pixels by the height of bubble 401 , i.e.. 23 pbc- 
els. The processor will count only pixels with gray lev- 
els of value M (23 of them) between a bottom point 
404 of the image and point 403. Since bubble 401 is 
two pbcels long, i.e., two pbcels with gray value K, 
those pixels are not counted. Therefore the actual 
height of the fluid along vertical line 402 will be two 



pbcels short of point 403 and equal to 23 pbcels. 

The procedure will t>e repeated for all possible 
vertical lines parallel to line 402 inside the image. An 
RS 170 standard camera can take 512 vertical lines 

5 parallel to line 402. The fluid height related to the first 
vertical line is A1 , to the second vertical line is A2, and 
so on. Each of the counts A1 , A2, and so on. is stored 
in the memory of processor 21 3. All of the counts are 
summed by the processor logic unit and divided by 

10 the number of counts. The total fluid height is the 
average height of ail of these vertical counts meas- 
urements and is expressed as the value h. 

h = (1/N) X [A1 + A2 + .... + A402 + A512] 

is where N equals the total number of vertical lines. The 
value of h is shown in Fig 4 as the distance in pixels 
and it expressed the average height of the fluid in a 
dynamic state. 

The h value of the fluid inside the cx^ntainer as a 

20 function of time (at successive positions along the 
production line) is plotted in Fig 6. Note that the h val- 
ue rises asymptotically, indicating that the gas in the 
container is dissolving and the fluid is reaching its sta- 
tic state. 

25 It is also possible to count pbcels with gray levels 

without modifying the gray levels of the acquired im- 
age, as explained below. 

The basic approach is the direct access method, 
where the image processor has access to the gray 

30 level value of each of the pbcels in the image. Access 
can be obtained by address or by intensity. Eac^ pixel 
has an address which Identifies Its position within the 
image. Each pixel has an intensity expressed by a 
gray level value. Access can be obtained, for exanv 

35 pie, to all the pbcels in the image with a given gray lev- 
el to acquire their address or to a specific address to 
acquire that pbcel's gray level value. The processor 
can acquire their intensity values and store them In a 
memory. Then a threshold pixel gray level is defined 

40 so that any pixel with a gray level value above the 
threshold is counted as a fluid pixel and a gray level 
below the threshold is counted as a bubble pixel. 
Then two proc^essor counters are assigned, one for 
the bubbles and one for the fluid. Each time the proc- 

45 essor detects a fluid pixel, it also raises the fluid count 
by one. Each time the processor detects a bubble pix- 
el, it raises the bubble exeunt by one. The processor 
sequentially accesses all the image pbcels or just an 
area of interest (AOI). A line or column within the inrv 

so age is identified as an AOI. 

The procedure of accessing each pbcei and the 
comparison of its gray level with the threshold level 
is done by software which requires a large amount of 
processing time. This Is because the software algo- 

55 rithm is slow compared to hardware functions. Modi- 
fying the image gray level and using the hardware his- 
togram function for counting pixels with gray levels is 
much faster than the software way and therefore pre- 
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ferable. 

Pixels are counted a long vertical line 402 to cal- 
culate fluid height 403. The vision system is selected 
to scan one vertical line as an area of interest (AOI). 
The processor is set to move the AOI from line to line 
to cover the entire body of fluid in real time and in se- 
quential order. 

Vertical line 402 is an image line composed of a 
row of pixels. The image processor compares inten- 
sity values of pixels along line 402 in sequential order. 
Pixels next to each other are compared for intensity 
values for boundary detection. (The image processor 
has access to each of the pbceis by position and val- 
ue). For example, a boundary pixel (related to a bub- 
ble boundary or a fluid boundary) can be selected 
easily. Whenever the change of pixel gray level value 
on top and below a selected pixel (along line 403) is 
more than 10% of the average gray level, the selected 
pixel is declared a boundary pixel. 

The average-gray level can be defined as the 
summation of ten gray level values of ten neighbor 
pixels divided by ten. Several methods of edge detec- 
tion are well known in the art, and may also be used 
to detect the edge(surface) of a bubble. Progressing 
along the line 403 and counting pixels between boun- 
daries indicates the fluid height and bubbles sized in 
number of pbceis. 

For example, the distance between point 403 and 
point 405 is 40 pbceis. Three boundaries are detected: 
the first 20 pbceis away from point 404, the second 22 
pixels away from point 404. and the third at 27 pixels 
away from point 404. The conclusion is that the bub- 
ble size is two pbceis long and the fluid level height 
along Una 402 Is 25 pbceis, excluding the bubble 
height. 

This Is only one way of counting pbceis and meas- 
uring dimensions. This method is considered slow 
and should be applied only in the case of the contain- 
ers which move at a slow throughput speed. 

The fluid height will be again evaluated by the 
same averaging procedure that took place in the prior 
art and. as explained above, after the image is modi- 
fled. 

Fig S-Measuring Bubbles In Dynamic State 

Fig 5 is also similar to Fig 3, and it demonstrates 
the procedure of nneasuring the number of bubbles 
expressed by the number of pixels within a container 
with the fluid in a dynamic state. 

The gray levels of Fig 3 are modified by the use 
of the LUTs of processor 21 3. They appear as shown 
in Fig 5, where the bubbles are darkened and set to 
a spec:if ic gray level K, versus the ones in Fig 3 which 
have multiple gray levels (not shown). The gray level 
of the bubbles Is different from that of the liquid and 
from the air domain above the liquid's wavy surface. 
Using the same procedure for gray level modification, 



the gray levels of the fluid are modified to be of value 
M, different that of the air domain, which has a gray 
level value L 

A long horizontal line 501 is used to calculate the 

5 number of bubbles The vision system is selected to 
have one horizontal line as an area of interest (AOt). 
The processor's histogram feature is set to count pix- 
els within the selected AOI only. The AOI can be 
moved from line to line to cover the entire body of fluid 

10 in real time and in sequential order. Horizontal line 
501 Is a modified image line composed of a row of pix- 
els. The number of bubbles are expressed as a num- 
ber of pixels. Bubbles 502, 503, and 504 lie along hor- 
izontal line 501, and have gray levels of value K, 

15 which is different from the gray level M of the fluid. 
The height of bubble 502 along horizontal line 501 is 
two pixels, the height of bubble 503 is three pixels, 
and the height of bubble 504 is two pbceis. Processor 
106 (Fig 1), or processor 213 (Fig 2) is set to count 

20 only pbceis with gray level value K. Therefore it will 
count the number of pbceis representing bubbles 
along horizontal line 501. The <x3unt value will be 2 + 
3 + 2 = 7 pixels. 

The procedure will be repeated for all horizontal 

25 lines parallel to line 501 in the liquid. An RSI 70 stan- 
dard camera can take 480 horizontal lines parallel to 
line 501 . To save processing time, the procedure is re- 
peated only over a preselected number of lines. The 
number of lines depends upon the type of gas dis- 

30 solved, the temperature of the liquid, and the pres- 
sure inside the container. For a standard beer bottle, 
the number of lines selected was 20. The total number 
of pixels representing the amount of bubbles along 
horizontal line 501 is B501 (B501 equals the number 

35 of pbceis representing bubble 502, plus those repre- 
senting bubble 503, plus those representing bubble 
504, i.e., five pixels as calculated in the previous 
paragraph). The amount of bubbles will be decrease 
with time as the fluid approaches a stable state where 

40 the gas is completely dissolved. 

The total number of pbceis representing the bub- 
bles In the first horb^ontal line Is B1 , In the second hor- 
izontal line Is B2, and so on. Each of the counts B1, 
B2, and so on, is stored in the memory of the proces- 

45 sor 21 3. All of the counts are summed by the procjes- 
sor logic unit and divided by the number of counts. 
The total amount of bubbles can be expressed as the 
average of all of these horizontal count measure- 
ments and is expressed as the value B. 

50 B = (1/N)x[B1 + B2 + .... + B480] (2) 

N equals to the total number of horizontal lines on 
which counts where performed. (N = 480 if camera 
RS170 is used and if bubbles are counted along all of 
the horizontal lines). 

55 The total number of pixels representing the bub- 

bles along one row may also be repeatedly counted 
over a perlcxj of time and averaged. 

The number of pbceis representing bubbles along 
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horizontal line 501 are saved in memory for further 
analysis. 

The value B for the average amount of bubbles as 
a function of time is plotted In Fig 7. 

It is still possible to count pixels with gray levels 5 
without modifying the gray levels of the acquired im- 
age as explained above In the last section under the 
discussion of 4. The same counting procedure is 
applied to horizontal image lines, instead of vertical 
Image lines. io 

Fig 6-Plot Of Fluid Level In Dynamic State 

Fig 6 is a time plot of the value h, the fluid level 
of Fig 4. This was measured six times at equally is 
spaced intervals, as represented by the dots at the 
topsof theordinates.The behaviorof h is exponential. 
At the value h = h6, the height of the fluid has reached 
its static value. The value of h6 can be obtained by ex- 
trapolation with time within a small error using the 20 
first three values, hi, h2, and h3. The rate of change 
of value h with time (dh/dt) is a good indicator of the 
viscosity of the fluid and its ability to hold dissolved 
gases. I.e.. the greater dh/dt, the greater the fluid's 
viscosity (Measuring beer bottles in one embodiment 25 
gave dh/dt values of 500, 200, 70, and 10 pixels per 
0.5 sec). 

Plot 603 is statistically obtained by inspecting 
good bottles, i.e., found to be within fluid final accep- 
tance levels. As long as newly inspected bottles have 30 
a fluid height behavior above plot 603, the line oper- 
ator will be assured that the static fluid level height 
will be within the acceptable range. A higher statistical 
range (not shown) represents overfilling. 

Nozzle 204 on the carousel is adjusted according 35 
to the result of Fig 6. For example, if static height h6 
is lower that line 603, then the opening of nozzle 204 
should be Increased to allow more fluid to pass Into 
the container. 

40 

Fig 7-Plot Of Bubbles Dissolved In A Dynamic 
State 

Fig 7 is a time plot of the value B from Fig 5. The 

value of B was measured six times at equally spaced 45 
intervals. The behavior of B exponentially decays. At 
the value B = B6 the gas in the fluid has reached its 
static value. The time that it will take the bubbles to 
dissolve (B6) can be obtained by extrapolation within 
a small error using the first three values, 81 , 82, and so 
B3. The rate of change of value B with time (dB/dt) is 
a good indicator of the viscosity of the fluid and its 
ability to hold dissolved gases. I.e., the greater dB/dt, 
the greater the viscosity of the fluid. 

if dB/dt is small, this indicates that there are not S5 
enough bubk>les in the container. This can be as a re- 
sult of a leak where bubbles escaped the-containers, 
or it can indicate that not enough gas was injected into 



the container. Both cases require a rejection of the 
product. If that situation occurs for the same nozzle. 
It indicates that the nozzle must be adjusted to inject 
more gas. It may also indicate a mechanical problem 
with the nozzle. In both cases the process quality en- 
gineer must be alerted. 

Plots 703 and 704 are statistically obtained by in- 
specting good bottles, i.e., those found to be with final 
acceptance levels for dissolved gases and accept- 
able product taste (as defined by the manufacturer). 
As long as nevsfly inspected bottles have bubble be- 
havior between plots 703 and 704, their dissolved 
gases and tastes will be within the acceptance range. 

Summary, Ramifications, And Scope 

Accordingly, the reader will see that we have pro- 
vided a method that will enable the inspection of fluid 
bubbles within a container, as well as the fluid fill lev- 
el, while both are in a dynamic state. This provides 
control of the quality of the product It also provides ' 
a method for predicting seal cap leakage by analyzing 
the exponential decaying of the bubbles to a steady 
state and estimating and controlling the final fluid lev- 
el in the container by analyzing the behaviorof the flu- 
id's height We also provide a method for predicting 
the final static liquid level inside the container by ana- 
lyzing the behavior of the fluid's height during the dy- 
namic mode. Further, we can correlate the indivkiual 
bottles with the filling carousel's nozzle to enable 
spedfic nozzle adjustment without affecting the 
whole filling machine. We also provide a way to cali- 
brate the amount of gas that a nozzle injects into the 
container by inspecting the rate of change of bubbles 
inskie the liquid in a dynamic state. Also by analyzing 
asymptotic behavior of liquid height and amount of 
bubbles, we provide viscosity values of liquids. We 
also provide a way to predict mechanical failures that 
introduced any undesired gas (air, carbon dioxide 
etc.) in the fluid. We also provide a way to monitor 
pasteurization and heat control. This is done by in- 
specting fluid and bubble behavior after the pasteur- 
izaton station, comparing it with a standard contain- 
er's behavior, and correlating this to the action station 
upon failure to match quality level. This Is done for 
process contml to determine any malfunction in the 
action station. 

While the above description contains many spe- 
cific details, these should not construed as limita- 
tions on the scope of the invention, but as exemplifi- 
cation of the presently preferred embodiments there- 
of. Many other ramifications and variations are pos- 
sible within the teachings to the invention. 

For example, other forces can create the dynamic 
force, such as nuclear-radiation, X rays, and sonic 
waves. 

In another example, we can shake the container 
to create a dynamic fluid condition inside the contain- 
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er. However this creates a need for extra hardware. 

Therefore, the scope of the invention should be 
determined, not only-by examples given, but by the 
appended daims and their legal equivalents. 



Claims 

1. A method for inspecting containers filled with a 

liquid containing bubbles, while said liquid and io 2. 
said bubbles are in a dynamic state and are mov- 
ing on a production line, with the use of a sensor 
and a processing unit having a memory, compris- 
ing: 

(a) moving a series of containers along a pro- is 
ductbn line past a filling station and an in- 
spection station, 

(b) filling said series of containers with a liquid 

and a gas at said filling station, said liquid in 3. 
said containers thereby containing bubbles 20 
which are suspended in said liquid, said iiquid 
and said suspended bubbles being in a dy- 
namic state as a result of said filling, 

(c) illuminating said containers with light at 
said inspection station so that resultant light 25 
comes from said containers, 

(d) sensing said resultant light coming from 
said containers with said sensor at said in- 
spection station and converting said resultant 

light to an electrical signal, 30 4. 

(e) said containers being illuminated and 
sensed when said liquid and said suspended 
bubbles are still in said dynamic state as a re- 
sult of said filling, 

(1) creating, from said electrical signal, a prod- 35 
uct image comprising a multiplicity of pixels 
with: 

(1 ) said pixels having a plurality of Intensi- 
ty levels expressed as a corresponding 
plurality of respective gray levels, 40 

(2) a first plurality of said multiplicity of pbc- 
els representing said liquid and having 
gray levels substantially on one side of a 
predetermined threshold level, and 

(3) a second plurality of said multiplicity of 45 
pixels representing said bubbles and hav- 
ing gray levels substantially on the other 
side of said predetermined threshold level, 

(g) modifying said product image to produce 

a modified product image so as to distinguish so 
liquid from bubbles by assigning a predeter- 
mined single liquid gray level value to all pixels 
on said one side of said predetermined 
threshold level, and assigning a predeter- 
mined different and single bubble gray level ss 
value to all pixels on said other side of said 
predetermined threshold level, 

(h) counting the number of pixels having said 



liquid gray level value and saving the resultant 
liquid count in memory, 
(i) counting the numt>er of pixels having said 
bubble gray level value and saving the resul- 
tant bubble pixel count in memory, and 
(j) analyzing said resultant liquid pixel count 
and said resultant bubble pixel count for liquid 
height and bubbles. 

The method claimed in claim 1 , further including 
analyzing said resultant liquid and bubble counts 
by comparing said resultant counts with those of 
an acceptable container, for example, to deter- 
mine if said container leaks, and/or to verify the 
quantity of bubbles Inside said product for quality 
control, and/or for controlling fill nozzle opera- 
tion, and/or for controlling fill level height. 

The method claimed in daim 1 or 2, wherein said 
counting the number of pixels having said liquid 
gray level value is" taken along a' vertical line of 
said liquid, said counting the number of pbcels 
having said bubble gray level value is also taken 
along a vertical line of said liquid, and wherein 
said analyzing said resultant iiquid count and re- 
sultant sakJ bubble count is performed by sub- 
tracting sakJ resultant bubble count from said re- 
sultant liquid count 

A system for inspecting containers filled with a 
liquid containing bubbles, while said liquid and 
said bubbles are In a dynamic state and are mov- 
ing on a production line, with the use of a sensor 
and a processing unit having a memory, compris- 
ing: 

(a) a production line comprising a filling sta- 
tion and an inspection station, 

(b) moving means for moving a series of con- 
tainers along said productbn line past said 
filling station and said inspection station, 

(c) filling means at said filling station forf illing 
said containers with a liquid and a gas so that 
said liquid in said containers will contain sus- 
pended bubbles, sakJ liquid and said sus- 
pended bubbles being in a dynamic state as 
a result of said filling, 

(d) illuminating means at said inspection sta- 
tion for illuminating said containers with light 
so that resultant light comes from each of saki 
containers, 

(e) sensing and converting means at said in- 
spection station for (a) sensing said resultant 
light coming from said one of said containers, 
said sensing and converting means induding 
said sensor, and (b) converting said resultant 
light to an electrical signal, 

(f) said illuminating means Illuminating said 
containers with light, and said sensing and 
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The system claimed in claim 4, 5 or 6, wherein 
said liquid pixel counting means is arranged to 
take several liquid counts at successive times 
and average the counts, and wherein said bubble 
pixel counting means is arranged to take several 
bubble counts at successive times and average 
the resultant count 



converting means sensing said resultant light 7. 
coming from said containers, when said liquid 
and said suspended bubbles are still in said 
dynamic state as a result of said filling, 

(g) image means for creating, from said elec- s 
trical signal, a product image comprising a 
multiplicity of pixels, said Image means being 
arranged to cause said 

pixels to have a plurality of intensity levels ex- B. 
pressed as a corresponding plurality of re- io 
spective gray levels, with a first plurality of 
said multiplicity of pixels representing said liq- 
uid and having gray levels substantially on 
one side of a predetenmined threshold level, 
and a second plurality of said multiplicity of is 
pixels representing said bubbles and having 
gray levels substantially on the other side of 
said predetermined threshold level, 

(h) modifying means for modifying said prod- 
uct image to produce a modified product im- 20 
age so as to distinguish liquid from bubbles by 
assigning a predetermined single liquid gray 
ievel value to all pixels on said one side of said 
predetermined threshold level, and assigning 
a predetermined different and single bubble 25 
gray level value to all pucels on said other skle 
of said predetermined threshold level, 

(i) liquid pixel counting means for counting the 
number of pixels having said liquid gray level 
value and saving the resultant liquid pixel 30 
count in menrwry, 

0) bubble pbcel counting means for counting 
the number of pbcels having said bubble gray 
level value and saving the resultant bubble 
pixel count in memory, and 35 
(k) analyzing means for analyzing said resul- 
tant liquid pbcel count and said resultant bub- 
ble pixel count for liquid height and bubbles. 

The system claimed In claim 5, further including 40 
means for analyzing said liquid and bubble 
counts by comparing said liquid and bubble 
counts with those of an acceptable bottle, for ex- 
ample, to determine if said container leaks, 
and/or to verify the quantity of bubbles inside 4S 
said product for quality control, and/or for control- 
ling fill nozzle operation, and/or for controlling fill 
level height 



The system claimed In claim 5 or 6, wherein said 50 
liquid pixel counting means is arranged to count 
the pbcels along a vertical line of said liquid and 
said bubble pixel counting means is also taken 
along a vertical line of said liquid, and wherein 
sakl analyzing means is arranged to subtract said 55 
resultant bubble pbcel count from said resultant 
liquid pbcel count 



A system for inspecting containers filled with liq- 
uid containing bubbles, while said liquid and said 
bubbles are in a dynamic state and are moving on 
a production line, with the use of an action station 
and an inspection station, comprising: 

(a) an action station means for operating on a 
plurality of containers so that said containers 
contain a liquid and a gas with said liquid be- 
ing in a dynamic state, and said gas being sus- 
pended in said liquid In the form of bubbles 
which also are in said dynamic state, 

(b) an inspection station means for creating 
an image of said containers filled with said liq- 
uid and said bubbles in said dynamic state 
with the use of a light source and a sensor, 

(c) said inspection station means being ar- 
ranged to create an image comprising a mul- 
titude of pixels having a plurality of gray levels 
representing said fluid and a multitude of 
other pbcels with a plurality of gray levels rep- 
resenting said bubbles. 

(d) said Inspection station means having a 
memory and a processor for obtaining inten- 
sity values of said pixels for obtaining gray lev- 
el values of said pixels, for mathematical c^i- 
culatlons, and for classifying some of said pbc- 
els as fluid pixels and other of said pixels as 
bubble pbcels and saving the classification In 
said memory, 

(e) counting means for performing a first 
cx>unt of said pbcels representing fluid and a 
second count of said pixels representing bub- 
bles, 

(f) analyzing means for analyzing sakl first 
count and sakl second count for quality and 
process control, and 

(g) correlating means responsive to said ana- 
lyzing means for indicating any malf unctk>n of 
said action station means for quality and proc- 
ess control. 

9. The system claimed in daim 8, further including 
means for correlating saW malfunction of said ao 
tion station means with an inspected container by 
the use of a sensor, and/or by the use of said 
processor. 

1 0. The system claimed in claim 8 or 9, wherein said 
action station means is a pasteurization machine. 
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11. The system as claimed in daim 8, 9 or 10, further 
including means for comparing said resultant liq- 
uid and bubble counts with those of an accept- 
able container, for example, for controlling oper- 
ation of said action station means, and/or to de- 
termine if said container leaks. 

12. The system claimed in any of claims 4 to 11, 
wherein said container contains a liquid selected 
from beer, soft drinks, water, or liquid medicines. 



10 



13. The system claimed in any of claims 8 to 12, 
wherein said counting means is arranged to take 
a count along a vertical line of said liquid, and 
wherein said analyzing means is arranged sut>- is 
tract said bubble count from said liquid count 

14. The system claimed in any of claims 8 to 13. 
wherein (a) said counting means is arranged to 

count the number of pixels haying sa^^^ 9ray 20 

level values at several successive times to obtain 
several liquid counts, and further including aver- 
aging said several liquid counts to obtain an aver- 
age liquid count, said average liquid count consti- 
tuting said liquid count, and (b) said counting 25 
means is also arranged to count the number of 
pbcels having said bubble gray level value at sev- 
eral successive times to obtain several bubble 
counts, and further including averaging said sev- 
eral bubble counts to obtain an average bubble 30 
count, said average bubble count constituting 
said bubble count. 

1 5. A system for monitoring quality and process con- 
trol of a production line by inspecting containers 35 
filled with liquid, while said liquid is In a dynamic 
state and said containers are moving on a pro- 
duction line, with the use of an action station and 

an inspection station, comprising: 

(a) an action station means for operating on 40 
said plurality of containers containing a liquid 
causing said liquid to being in a dynamic state 

as a result of said operatk>n, 

(b) an inspection station means for creating 

an image of said containers filled with said flu- 45 
id and said bubbles in said a dynamic state 
with the use of a light source and a sensor, 

(c) said inspection station means being ar- 
' ranged to create an image comprising a mul- 
titude of pbcels having a plurality of gray levels so 
representing said fluid, 

(d) said inspection station means having a 
memory and a processor for obtaining inten- 
sity values of said pixels for obtaining gray lev- 
el values of said pixels, for mathematical cal- ss 
culations, and for classifying said pbcels as 
fluid pixels eras bubble pixels and saving said 
classification in said memory. 



(e) counting means for performing a first 
count of said pbcels representing fluki and 
second count of any pbcels representing bub- 
bles. 

(f) analyzing means for analyzing said first 
count and saki second count for quality and 
process control, and 

(g) correlating means responsive to said ana- 
lyzing means for Indicating any malf unctton of 
said action station means for quality and proc- 
ess control. 

16. The system claimed in claim 15, wherein said in- 
specting means is also arranged to detect un- 
wanted bubbles in sakJ fluid. 

17. The system claimed in claim 15 or 16, wherein 
said second count equals zero. 

1 8. The system claimed in claim 1 5, 1 6 or 1 7, wherein 
(a) said first count is performed at several suc^ 
cessive times to obtain an average liquki count, 
said average liquid count constituting said first 
count, and (b) said counting means performs said 
second count at several successive times to ot>- 
tain several second counts, and further including 
averaging said several second counts to obtain 
an average bubble count, sakI average bubble 
count constituting said second count 

1 9. A method for monitoring quality and process con- 
trol of production line by inspecting containers fil- 
led with liquid containing bubbles, while said liq- 
uid and said bubbles are in a dynamic state and 
are moving on a production line, with the use of 
an action station and an inspection station, com- 
prising: 

(a) operating on a plurality of containers at an 
action station so that said containers contain 
a liquid and a gas with said liquid in a dynamic 
state, and said gas is suspended in said liquid 
in the fonm of bubbles which also are In said 
dynamic state, 

(b) creating with an inspection statk>n an inrt- 
age of said containers filled with said liquid 
and said bubbles in said dynamic state with 
the use of a light source and a sensor, 

(c) said image cx>mprising a multitude of pix- 
els having a plurality of gray levels represent- 
ing said fluid, and a multitude of other pixels 
with a plurality of gray levels representing said 
bubbles, 

(d) obtaining intensities of pbcels at said in- 
spection station using a processor to obtain 
gray level values of said pixels for mathemat- 
ical calculatk>ns, and for classifying some of 
said pixels as fluid pbcels and others of said 
pixels as bubbles. 
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(e) saving the classification of said pixels in a 
memory, 

(f) counting said pixels which represent liquid 
to provide a first count of liquid pixels and 
counting said pixels which represent bubbles s 
to provide a second count of pixels represent- 
ing bubbles. 

(g) analyzing said first count and said second 
count for quality and process control, and 

(h) con-elating the analysis of said first and io 
second counts with said action station to Indi- 
cate any malfunction of said action station for 
quality and process control. 

20. The method claimed in dalm 19, further Including is 
correlating any malfunction of said action station 
with an inspected container by the use of a sen- 
sor. 

21. The method daimed in daim 19 or 20, wherein 20 
said action station is a pasteurization machine. 

22. The method daimed in dalm 19, 20 or 21 , further 
including analyzing said first and second counts 
by comparing said first and second counts with 25 
those of an acceptable container, for example, to 
determine if said container leaks, and/or to verify 
the quantity of liquid and bubbles inside said 
product for quality and process control, and/or for 
controlling operation of said action station, and/or 30 
for controlling liquid fill level height. 



23. The method daimed in any of daims 1 to 3 or 19 
to 22, wherein said container contains a liquid se- 
lected from beer, soft drinks, water or liquid med- 
icines. 

24. The method claimed in any of dalms 19 to 22. 
wherein said counting takes a count along a vert- 
ical line of said liquid, and wherein said analyzing 
subtracts said second countfrom said first count 



26. A method for monitoring quality and process con- 



trol of a production line by inspecting liquid in a 
dynamic state and moving on a productk>n line, 
with the use of an action statk>n and an inspection 
station, comprising: 

(a) operating on a plurality of containers at an 
action station so that said containers contain 
liquid In a dynamic state, 

(b) creating, with said inspection station inn- 
ages of said containers filled with said liquid 
in said dynamic state with the use of a light 
source and a sensor, 

(c) said image comprising a multitude of pix- 
els having a plurality of gray levels represent- 
ing saki liquid, 

(d) obtaining intensities of said pixels at said 
inspection station using a processor to obtain 
gray level values of said pixels for mathemat- 
ical calculations, and for dassif ication of said 
pixels as fluid pixels or bubble pixels, 

(e) saving the dassif ication of said pbcels in a 
~ memory, 

(f) counting said pixels which represent liquid 
to provide a first count of liquid pbcels and 
counting any pixels which represent bubbles 
to provide a second count of any pixels repre- 
senting bubbles. 

(g) analyzing said first count and said second 
count for quality and process control, and 

(h) correlating the analysis of said first and 
second counts to said action station to Indi- 
cate malfunction of said action station for 
quality and process control. 

27. The method daimed in claim 26. wherein said 
35 analyzing is performed to detect unwanted bub- 
bles In said fluid. 

28. The method claimed In daim 26 or 27, wherein 
said liquid contains no bubbles so that said sec- 

40 ond count equals zero. 

29. The method claimed In dalm 26, 27 or 28, where- 
in (a) said counting performs said first count at 
several successive times to obtain several first 
counts, and further induding averaging said sev- 
eral first counts to obtain an average liquid count, 
said average liquid count constituting said first 
count, and (b) said second count is performed at 
several successive times to obtain several sec- 
ond counts, and further induding averaging said 
several second counts to obtain an average bub- 
ble count, said average bubble count constituting 
said second count 

30. A method for monitoring quality and process con- 
trol of a production line by inspecting liquid in a 
dynamic state and moving on a productton line, 
with the use of an action station and an inspection 



25. The method daimed in any of daims 1 to 3 or 19 
to 24, wherein (a) sakJ counting counts the num- 
ber of pbcels having said iiquki gray level values 45 
at several successive times to obtain several liq- 
uid counts, and further Including averaging said 
several liquid counts to obtain an average liquid 
count said average liquid count constituting said 
liquid count and (b) said counting counts the so 
number of pixels having said tnjbble gray level 
values at several successive times to obtain sev- 
eral counts, and further including averaging said 
several bubble counts to obtain an average bub- 
ble count, said average bubble count constituting ss 
said bubble count 
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station, comprising: 

(a) operating on a plurality of containers at an 
action station so that said containers contain 
liquid in a dynamic state, 

(b) creating, with said inspection station an s 
image of said containers f ilied with said liquid 

in said dynamic state with the use of a light 
source and a sensor, 

(c) said image comprising a multitude of pix- 
els having a plurality of gray levels represent- io 
ing said liquid, 

(d) obtaining the intensities of pbcels at said in- 
spection station using a processor to obtain 
the gray level values of said pbcels for mathe- 
matical calculations, and for classifying said is 
pixels as fluid pbcels or as bubble pixels, 

(e) saving the classification of said pbcels in a 
memory, 

(f) counting said pixels representing liquid to 
provide a fluid cx>unt. 20 

(g) analyzing said fluid count for quality and 
process control, and 

(h) correlating the analysis of said fluid count 
to indic^ate any malfunction at said action sta- 
tion. 25 
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